Visualizing Deep Neural Networks with Topographic Activation Maps

نویسندگان

چکیده

Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity DNNs makes it difficult to understand how they solve their learned task. To improve explainability DNNs, we adapt methods from neuroscience that analyze complex and opaque systems. Here, draw inspiration uses topographic maps visualize brain activity. also activations neurons as maps, research techniques layout two-dimensional space such similar activity are vicinity each other. In this work, introduce compare obtain DNN layer. Moreover, demonstrate use activation identify errors or encoded biases training processes. Our novel visualization technique improves transparency DNN-based decision-making systems is interpretable without expert knowledge Learning.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

MolMap - Visualizing Molecule Libraries as Topographic Maps

We present a new application for graph drawing and visualization in the context of drug discovery. Combining the scaffold-based cluster hierarchy with molecular similarity graphs — both standard concepts in cheminformatics — allows one to get new insights for analyzing large molecule libraries. The derived clustered graphs represent different aspects of structural similarity. We suggest visuali...

متن کامل

Deep Neural Networks with Multistate Activation Functions

We propose multistate activation functions (MSAFs) for deep neural networks (DNNs). These MSAFs are new kinds of activation functions which are capable of representing more than two states, including the N-order MSAFs and the symmetrical MSAF. DNNs with these MSAFs can be trained via conventional Stochastic Gradient Descent (SGD) as well as mean-normalised SGD. We also discuss how these MSAFs p...

متن کامل

Activation Ensembles for Deep Neural Networks

Many activation functions have been proposed in the past, but selecting an adequate one requires trial and error. We propose a new methodology of designing activation functions within a neural network at each layer. We call this technique an “activation ensemble” because it allows the use of multiple activation functions at each layer. This is done by introducing additional variables, α, at eac...

متن کامل

Matrix learning for topographic neural maps

OF THE DISSERTATION Matrix Learning for Topographic Neural Maps

متن کامل

Local matrix adaptation in topographic neural maps

The self-organizing map (SOM) and neural gas (NG) and generalizations thereof such as the generative topographic map constitute popular algorithms to represent data by means of prototypes arranged on a (hopefully) topology representing map. However, most standard methods rely on the Euclidean metric, hence the resulting clusters are isotropic and they cannot account for local distorsions or cor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Frontiers in artificial intelligence and applications

سال: 2023

ISSN: ['1879-8314', '0922-6389']

DOI: https://doi.org/10.3233/faia230080